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(S7) Abstract: An advanced traffic shaper is provided for shaping real-time traffic in an IP-based network while simultaneously pro- 
^ viding keep-a live bandwidth for best-effort traffic. The traffic shaper comprises a packet classifier coupled to receive an mcoming 
packeffrom the network and to classify the incoming packet as one of a real-time packet and a best-e ffort packet ; a packet discard- 
® ing block coupled to perform traffic shaping of the incoming packet from the packet classifier and discard the mconung packet m 
O accordance with ttaffic shaping parameters; connection queues coupled to lemporaiy store real-time packets and best-effort packets 
^ from the packet discarding block, respectively; and a packet scheduling block coupled to send the real-ume and best-effort packets 
1^ from the connection queues to an outgoing device in accordance with the traffic shaping parameters. 
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REAL-TIME TRAFFIC SHAPER WITH KEEP-ALIVE 
PROPERTY FOR BEST-EFFORT TRAFFIC 



BACKGROUND OF THE INVENTION 

Technical Field 

The present invention relates to traffic control in a data communication system 
and more particularly, relates to a traffic shaper for controlling traffic bandwidth usage in 
an IP (Internet Protocol) network to guarantee proper QoS (Quality of Service) for 
different types of real-time traffic applications such as interactive audio and/or video while 
concomitantly providing keep-alive bandwidth for best-effort traffic. 

Related Art 

In recent years, increased usage of the Internet has resulted in scarcity of network 
capacity, and compromised performance of traditional applications. At the same time, 
new applications such as interactive audio and/or video, including video-conferencing or 
Voice over IP (VoIP) have emerged which demand much improved QoS (Quality of 
Service). As a result, network service providers (both enterprise and traditional ISPs) are 
pressured to provide different customers alternative levels of service. 

One of the most promising of these services is Differentiated Sen/ices (DiffServ), 
which provides for classification of different flows of IP data packets and prioritizing 
scheduling of these IP flows in routers. These schemes work best when traffic bandwidth 
of individual end users is bounded and contains as small fluctuations as possible. The 
boundedness property of IP data packets can be achieved by usin g traffic shaping, o r 
limitingth e traffic bandwidth to an agreed-upon number of IP data packets per time unit 
and discarding excess traffic. 



Several traffic shaping techniques may be provided to shape the traffic so that the 
traffic does not exceed a predetemiined transmission rate for each destination in an IP 
network. Existing IP traffic shapers are designed to limit bandwidth usage of TCP 
(Transfer Control Protocol) traffic. Subsequently, those traffic shapers are not suitable for 
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special requirements of high-priority, interactive real-time traffic with small packet size, 
such as video-conferencing or Voice over IP (VoIP). At the same time, it is desirable to 
prevent TCP connections from being exhausted of bandwidth. Accordingly, there is a 
need for an advanced traffic shaper advantageously configured for priority fonwarding of 
real-time traffic while providing keep-alive bandwidth for "best-effort" traffic at the same 
time. Also needed is an advanced traffic shaper used together with QoS (Quality of 
Service) core network technology, such as an ATM network. 

SUMMARY OF THE INVENTION 
Accordingly, various embodiments of the present invention are directed to an 
advanced traffic shaper for shaping real-time traffic in an IP-based network while 
simultaneously providing keep-alive bandwidth for best-effort traffic. Such a traffic sh^r ]^ 
may be an algorithm integrated into existing operating system (OS) of a host processor ^ 
and/or a computer readable medium for use in a host processor for priority fon«/arding for 
real-time traffic and avoiding correlated loss for real-time streams while providing keep- 
alive bandwidth for best-effort traffic. In addition, the traffic shaper may be installed in the 
host processor of a source terminal or a destination terminal in an IP-based network 
which uses a bandwidth-limited IP link for providing connection between the source 
terminal and the destination temiinal. 

In accordance with the present invention, the traffic shaper may comprise a 
packet classifier coupled to receive an incoming packet from the network and to classify 
the incoming packet as one of a real-time packet and a best-effort packet; a packet 
discarding block coupled to perform traffic shaping of the incoming packet from the 
packet classifier and discard the incoming packet in accordance with traffic shaping 
parameters; connection queues coupled to temporary store real-time packets and best- 
effort packets from the packet discarding block, respectively; and a packet scheduling 
block coupled to send the real-time and best-effort packets from the connection queues to 
an outgoing device in accordance with the traffic shaping parameters. 
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The connection queues may include a real-time queue for storing the real-time 
packets and a best-effort queue for storing the best-effort packets. Both real-time and 
best-effort queues correspond to packet buffers constructed from first-in-first-out (FIFO) 
memory for storing real-time packets and best-effort packets, respectively. 
5 The packet discarding block may be executed to discard an incoming packet by 

steps of: determining whether the real-time and best-effort queues are empty; when the 
real-time and best-effort queues are empty, resetting internal counters and a scheduled 
transmission time of the next incoming packet; determining whether a real-time latency is 
greater than a maximum latency value of the real-time queue; when the real-time latency 
10 is greater than the maximum latency value of the real-time queue, discarding the real- 
time packet input from the packet classifier; determining whether a total latency is greater 
than a maximum latency value of both the real-time and best-effort queues; when the 
total latency is greater than the maximum latency value of both the real-time and best- 
effort queues, adding a best-effort packet to a tail of the best-effort queue and discarding 
15 a best-effort packet from a head of the best-effort queue; determining whether a length of 
the real-time queue is greater than a maximum queue length of the real-time queue; 
when the length of the real-time queue is greater than a maximum queue length of the 
real-time queue, discarding the real-time packet input from the packet classifier; 
detemiining whether a length of the best-effort queue is greater than a maximum queue 
20 length of the best-effort queue; when the length of the best-effort queue is greater than a 
maximum queue length of the best-effort queue, adding a best-effort packet input from 
the packet classifier to the tail of the best-effort queue and discarding a best-effort packet 
from a head of the best-effort queue: determining whether there is concurrency and time 
to discard a real-time packet to make room for best-effort packets; when there is 
25 concurrency and time to discard the real-time packet, discarding the real-time packet to 
implement the keep-alive bandwidth for best-effort packets; and placing the real-time 
packet that was not discarded in the real-time queue. 

The packet scheduling block may be periodically executed to schedule output of 
an incoming packet by the steps of: determining whether both the real-time and best- 
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effort queues are empty; determining whether there is concurrency and time to transmit 
the best-effort packet from the best-effort queue; when there is concurrency and time to 
transmit the best-effort pacl<et. checking whether total bandwidth constraint allows 
transmission of the best-effort packet from the best-effort queue head; when transmission 
is allowed, updating a time of next transmission and transmitting the best-effort pacl<et to 
the outgoing device; detemiining whether the real-time queue is not empty and time for 
transmission of the real-time packet is permitted; when the real-time queue is not empty 
and time for transmission of the real-time packet is permitted, updating the transmission 
time and transmitting the real-time packet to the outgoing device from the real-time queue 
head; determining whether the best-effort queue is not empty and time for transmission of 
the best-effort packet is permitted; and when the best-effort queue is not empty and time 
for transmission of the best-effort packet is permitted, updating the transmission time and 
transmitting the best-effort packet to the outgoing device from the best-effort queue head. 

The present invention is more specifically described in the following paragraphs 
by reference to the drawings attached only by way of example. 

BRIEF DESCRIPTION OF THE DRAWINGS 

A more complete appreciation of the present invention, and many of the attendant 
advantages thereof, will become readily apparent as the same becomes better 
understood by reference to the following detailed description when considered in 
conjunction with the accompanying drawings in which like reference symbols indicate the 
same or similar components, wherein: 

FIG. 1 illustrates an IP packet for use in an IP-based network according to the 
principles of the present invention; 

FIG. 2 illustrates an IP-based network of a source temninal and a destination 
terminal having an advanced traffic shaper incorporated therein for controlling traffic 
bandwidth usage to guarantee proper QoS (Quality of Sen/ice) for different types of real- 
time traffic applications while concomitantly providing keep-alive bandwidth for best-effort 
traffic according to the principles of the present invention; 
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FIG. 3 is a functional implementation of an advanced traffic shaper for controlling 
bandwidth usage to guarantee proper QoS (Quality of Service) for different types of real- 
time traffic applications while concomitantly providing keep-alive bandwidth for best-effort 
traffic according to the principles of the present invention; 

FIG. 4 is a flowchart representation of an IP packet discarding algorithm of the 
packet discarding block according to the principles of the present invention; 

FIG. 5 is a flowchart representation of an IP packet scheduling algorithm of the 
packet scheduling block according to the principles of the present invention; 

FIG. 6 illustrates the shaper output bandwidth of the advanced traffic shaper as a 
function of time; 

FIG. 7 illustrates the length of real-time queue as a function of packet sequence 
number; 

FIG. 8 illustrates the cummulative number of discarded real-time packets as a 
function of packet sequence number, 

FIG. 9 illustrates one preferred usage implementation of an IP-based network of a 
source temiinal and a destination terminal having an advanced traffic shaper incorporated 
therein for controlling traffic bandwidth usage to guarantee proper QoS (Quality of 
Service) for different types of real-time traffic applications while concomitantly providing 
keep-alive bandwidth for best-effort traffic according to the principles of the present 
invention; and 

FIG. 10 illustrates another preferred usage implementation of an IP-based 
network of a source terminal and a destination terminal having an advanced traffic shaper 
Incorporated therein for controlling traffic bandwidth usage to guarantee proper QoS 
(Quality of Service) for different types of real-time traffic applications while concomitantly 
providing keep-alive bandwidth for best-effort traffic according to the principles of the 
present invention. 

DETAIL DESCRIPTION OF EMBODIMENTS OF THE INVENTION 
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The present invention is applicable for use with ail types of data communication 
networks and communication services. However, for the sake of simplicity, discussions 
will concentrate mainly on an advanced traffic shaper for use in DiffServ-enhanced IP 
networks for providing guaranteed QoS (Quality of Sen,ice) for interactive real-time traffic 
of Voice over IP (VoIP), although the scope and implementation of the present invention 
is not limited thereto. For example, the novel traffic shaper may be implemented for real- 
time traffic of video or a combination of video and audio, such as video-conferencing for 
delivery of video over IP (although required bandwidth is larger but the basic problems 
associated with delivery of video over IP remain essentially the same as Voice over IP). 

In addition, there may be several special network requirements for high-priority 
Voice over IP (VoIP) applications. For example, the most important requirement imposed 
by Voice over IP (VoIP) on the network delivery is limit on end-to-end delay. The exact 
upper limit varies depending on the source terminal, but 250 ms is an oft-quoted value for 
one-way delay limit. The end-to-end delay limit is not dependent on the chosen audio 
decoding scheme, although an audio codec may give rise to extra delay in the fomn of 

processing and framing. 

Another requirement is a limit for packet loss. Typically, a single VoIP packet 
varies one or more voice samples (frames), and the loss of such a packet translates to 
several tens of milliseconds (ms) of lost audio data. The sensitivity on packet loss rate 
depends on the audio codec (encoder/decoder) used. The negative effects of packet loss 
can be reduced to some extent with means such as interpolating over a single missing 
sample, including Fonvard Error Correction (FEC) data - for example, a low-bit rate copy 
of a previous audio data frame - into data packets. Regardless of the audio codec 
(encoder/decoder) and the interpolating means chosen In combating against packet loss, 
the audio quality may suffer or may be compromised after a sufficiently long sequence of 
missing packets. Hence if packet loss must be inflicted upon a VoIP stream, it is 
desirable to spread packets to be removed over time and to avoid correlated losses. 

in addition to being able to prioritize real-time traffic, there are other desirable 
properties for the novel real-time traffic shaper. For usage with low-bandwidth links with 
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mixed traffic types, it is useful to prevent best effort streams from being exhausted from 
bandwidth in case of real time stream nominal bandwidth being equal or larger than the 
link bandwidth. This way the time-outs associated with protocols such as FTP (File 
Transfer Protocol) can be avoided. 
5 Attention now is directed to the drawings and particularly to FIG. 1 . an IP packet 

for use in an IP-based network according to the principles of the present invention is 
illustrated. As shown in FIG. 1 . an IP packet 2 consists of a segment of data 2B and a 
small IP header 2A prepended to the data 2B. The IP packet 2 may represent, but may 
not be limited to. real-time traffic of Voice over IP (VoIP), or best-effort (BE) traffic, such 
10 as FTP. The IP header contains, for example. IP addresses fields (32-bit global Internet 
address, generally consisting of a network Identifier and a host identifier), a version field 
used to specify which version of the IP is represented in the IP packet (for example. IP 
Version 4 and IP Version 6). a type of service field used to specify how the IP packet is to 
be handled in IP-based networks which offer various service qualities, and a header 
15 checksum field used to verify transmission error. Other IP fields such as flags and 

fragment offset fields, a total length field, an ID field, a time to live field and a protocol 
field may also be included in such an IP header. 

FIG. 2 illustrates an IP-based network of a source terminal 20 and a destination 
terminal 20 having an advanced traffic shaper incorporated therein for controlling traffic 
20 bandwidth usage to guarantee proper QoS (Quality of Service) for different types of real- 
time traffic applications while concomitantly providing keep-alive bandwidth for best-effort 
traffic according to the principles of the present invention. As shown in FIG. 2. an IP 
bandwidth-limited link 10 is utilized to connect a source terminal 20 to a destination 
terminal 30. The IP bandwidth-limited link 10 may represent a low bandwidth link such 
25 as. for example, an integrated service digital service (ISDN) link and a modem link that 
connect to the source terminal 20 and the destination terminal 30. The IP bandwidth- 
limited link 10 may be connected at one end of an IP-based network of an Internet 
Service Provider (ISP), an Internet and different source and destination networks, 
including, for example, a public switched telephone network (PSTN) and an integrated 



NSDCX^ID -cWO 0103400A2 I > 



10 



15 



20 



25 



WO 01/03400 PCT/IBOO/00888 

8 

services digital network (ISDN) that provide linkage between the ISP network ingress host 
and their receivers (see FIGs. 9 and 10). The source terminal 20 includes at least a host 
22 and a network interface controller (NIC) 24. Likewise, the destination terminal 30 
contains at least a host 32 and a network interface controller (NIC) 34. 

In the source terminal 20. the host 22 generates data which is forwarded to the 
network interface controller (NIC) 24. The NIC 24 of the source terminal 20 transforms 
incoming data from host 22 into IP packets 2 and injects the IP packets 2 into the IP- 
based network 10. The rate of that IP packets are injected into the IP-based network 10 
and the outward flow of IP packets 2 are controlled and managed by the NIC 24 to avoid 
congestion and to limit bandwidth usage of IP packets in the IP-based network 10. The 
IP-based network 10 accepts incoming IP packets 2 and fonwards the same to destination 
terminal 30 according to the information contained in the IP header. The NIC 34 of the 
destination terminal 30 receives the IP packets 2 from the IP-based network 10. 
transforms the same into data and fonwards the data to the host 32. 

Included in the NIC 24 of source terminal 20 (also in the NIC 34 of destination 
terminal 20 for bidirectional communications on an end-to-end basis) is a novel traffic 
shaper implemented to guarantee proper QoS (Quality of Sen/ice) for different types of 
real-time traffic applications while concomitantly providing keep-alive bandwidth for best- 
effort traffic according to the principles of the present invention. As contemplated by the 
present invention, the advanced traffic shaper is implemented by an algorithm configured 
from the beginning with a view on providing priority fonwarding for real-time traffic and 
avoiding correlated loss for real-time streams while providing keep-alive bandwidth for 
best-effort traffic at the same time. The algorithm implementation may rely on the use of 
standard programming methods using high level program languages such as C or C++ 
and a general purpose (host) processor. The algorithm may be integrated into existing 
operating system (OS) of a host processor and/or a computer readable medium for use in 
a host processor for priority fonwarding for real-time traffic and avoiding correlated toss for 
real-time streams while providing keep-alive bandwidth for best-effort traffic. 
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Referring now to FIG. 3, a functional block diagram of an advanced traffic shaper 
300 constructed according to the principles of the present invention is illustrated. As 
shown in FIG. 3. the traffic shaper 300 includes several components, including a packet 
classifier 310, a packet discarding block 320, a set of connection queues 330 of real-time 
5 (RT) queue and best-effort (BE) queue for real-time (RT) packets and best-effort (BE) 
packets, and a packet scheduling block 340. These components may be embodied as 
software components or modules configured and/or written in accordance with the traffic 
shaping algorithm using those high level program languages such as C or C++ for priority 
fonwarding for real-time traffic and avoiding correlated loss for real-time streams while 
10 providing keep-alive bandwidth for best-effort traffic in an IP-based network. 

The packet classifier 310 is used to receive incoming IP packets 2 and to classify 
such incoming IP packets 2 as either real time (RT) packets or best effort (BE) packets. 
Classifier functionality is well known in IP architecture and therefore, needs not be 
described in detail herein. 
15 The packet discarding block 320 is used to perform traffic shaping of an incoming 

packet from the packet classifier 310 and discard the incoming IP packet 2 if the packet 
fails to comply with bandwidth parameters (that is. too many input packets with respect to 
the shaper output bandwidth limited). The packet discarding block 320 is triggered to 
perform traffic shaping on an incoming packet 2 when an incoming packet 2 arrives from 
20 the packet classifier 310. The packet discarding block 320 contains packet counters used 
to balance real-time (RT) packets discards in order to achieve bandwidth for best-effort 
(BE) traffic in situations where there is concurrency. 

The connection queues 330 includes a real-time (RT) queue 330A and a best- 
effort (BE) queue 330B for temporary storing real-time (RT) packets and best-effort (BE) 
25 packets respectively. In a preferred embodiment of the present invention, the connection 
queues 330 are packet buffers constructed from FIFO (first-in-first-out) memory for 
storing RT packets and BE packets, respectively. 
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The packet scheduling block 340 is used to send RT and/or BE packets to an 
outgoing device (e.g.. host 34 of destination temiinal 30) in accordance v.ith bandwidth 
parameters. 

The functionality of both the packet discarding block 320 and the packet 
5 scheduling block 340 of the advanced traffic shaper 300 is controlled by the following 
quantities: 

The length (/p) and type {tp) of input packet. 
The current point in time, denoted t. 

The queue lengths, lenn and len^ for the real-time (RT). and best 
,0 effort (BE) queues respectively. 

The shaper bandwidth. BW. 

Maximum latency values for the RT queue, and the complete 
queue system, denoted LATrfand LATtot, respectively. 



15 



20 



25 



30 



35 



Maximum queue lengths for both RT and BE queues denoted 
QLEN„ and QLEN^e- These value should be set large enough so that 
queue latency, not Ihe queue length, is the cause for packet discarding. 

A time parameter that allows for compensation of low jitter with 
less exact shaping or vice versa. It is named tfree. and is explained in 
greater detail below in the context of algorithm descnption. 

Bandwidth for best-effort traffic which is maintained even at times 
when there is enough real time traffic to fill the whole pipe. Denoted 

BWBE.min 

In addition, a few internal variables are of interest for the functionality of the 
advanced traffic shaper 300. and p. are packet counters that are used to balance real- 
time packet discards (in order to achieve BWbe../^ for best-effort traffic) in situations 
where there is concurrency, t^e will indicate the next point in time when the advanced 
traffic shaper 300 is free to send the next packet according to the bandwidth specified. 

The pity - parameters work as follows. In a state of concurrency (both RT and BE 
queues 330A-330B are active) each RT packet that passes through the traffic shaper 300 
will add to the RT queue 330A according to the following fomnula: 

P, := Pi + Cp* BWBE.min)/BW 

P2 := P2 +(/p*BWBE.mln)/BW 
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Which indicates the bit count of a transmission of equal time length as Ip 
transmitted over the traffic shaper bandwidth BW but calculated in BWee^n^n- In other 
words, a virtual channel is maintained for best-effort traffic, even though the bit count 
contributed by a single RT-packet is too small to fit a single BE packet. 

5 Whenever a new RT packet arrives and the traffic shaper 300 is in a state of 

concurrency, the length of the packet is compared to p.. and is discarded if the packet 
length is larger than p,. and the p, will be decremented by the same amount. If a small 
flow of BE traffic is desired to be maintained even as the traffic shaper 300 is completely 
filled with RT traffic, some extra RT packets must be discarded to make room for the BE 

,0 packets. In this manner, the RT packets that will be discarded will be spread out in the 
throughput. 

The packet discarding block 320 is triggered on an incoming packet, and operates 
based on an IP packet discarding algorithm as follows: 

15 Update the memory of the shaping algorithm if necessary 

if teHrt + len^^e = 0 

A(/ - t/ree) > tfree 

then 

tfree^t - tfreei 

20 Pi= P2 =0; 

Discard RT packets based on latency 
if latency{lenrt)>LATtot 
then 

05 discard (p); 

fi; 

Discard BE packets based on latency 
if latency(lenrt^lenbe)>LATtot 
then 

3Q add Jo_best_effort (p); 

p := first_of_best_effort(); 
discard (p); 

fi; 

Discard packets because queue is full 
35 i{{tp = REAL TIME) a (/ewit > QLENrf) 

then 

discard (p); 
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= BEST EFFORT) a (/en*. ^ QLENh.) 
then 

adcl_to_best_effort (p); 
p := first_of_best_effort{), 
discard (p) 

fi; 

Discard real-time packets in a concurrency situation 

if (/,. = REAL TIME) a (/p ^ pi) 
then 

Pi := Pi -/p 
discard (p); 

fi 

add_to_queue (p); 



Basically, the IP packet discarding algorithm as described provides several 
underlying functions: The first function relates to determining whether the real-time (RT) 
and best-effort (BE) queues 330A-330B are empty. If the RT and BE queues 330A-330B 
are empty, resetting counters p1 and p2 and the scheduled transmission time of the next 
packet. The second function relates to the RT packet and detemnining whether RT 
latency is too large. If the RT latency Is too large, discarding the RT packet. The third 
function relates to the BE packet and determining whether the total latency is too large. If 
the total latency is too large, adding a BE packet to the tail of the BE queue 330B and 
discarding a packet from the BE queue head (best effort early warning property). The 
fourth function relates to the RT packet and determining whether the RT queue length is 
too large. If the RT queue length is too large, discarding the RT packet. The fifth function 
relates to the BE packet and determining whether the BE queue length is too large. If the 
BE queue length is too large, adding a BE packet to the tail of the BE queue 330B and 
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discarding a BE packet from the BE queue head (early warning). The sixth function 
relates to the RT packet and determining whether there is concurrency (both RT and BE 
queues 330A-330B are active) and p1 counter indicates that it is time to discard a RT 
packet to make room for BE packets. If there is concurrency and p1 counter indicates 
that it is time to discard the RT packet, discarding the RT packet to implement the keep- 
alive bandwidth BW for BE packets. The seventh function relates to determining whether 
an incoming packetO that was not discarded is placed in the appropriate queues 330A- 
330B. 

Turning now to FIG. 4. a detailed flowchart representation of an IP packet 
discarding algonthm of the packet discarding 1-ock 320 is Illustrated. The algoritho, of the 
packet discarding block 320 is executed by an operating system (not shown) for each 
incoming packet 2. dassif^d either as real-time (RT) or best-effort (BE), from the packet 
Classifier 310 at step 400. When an IP packet Is input from the packet classifier 310. the 
packet discarding block 320 detemtines whether the RT and BE queues 330A-330B are 
empty (len, . len» = 0. and > ^ at step 410. If .i,e RT and BE queues 330A-330B 
are not empty at step 410, the packet discarding block 320 proceeds to step 414. If the 
RT and BE queues 330A-330B are empty (len„ * len„ = 0; and t-t„. > t^) at step 410. 
however, the packet discarding block 320 reset counters pi and p2 (p1 = p2 = 0) and the 
scheduled transmission time of the next packet (t«. := t-t,.,) at step 412. 

Next, the packet discarding block 320 determines whether the RT latency is larger 
tt,an the maximum latency value for RT queue 330A (latency(len„) > lAT^ at step 414. If 
the RT latency is too large, the packet discarding block 320 discards the input RT packet 
at step 416. If the RT latency is not too large at step 414, the packet discarding block 320 
proceeds to determine wt^ether the total latency is larger than the maximum latency value 
i for the complete queue system 330 (latencyden, *len«) > LAT„,) at step 41 8. If the total 
latency Is too large, the packet discarding block 320 adds a BE packet to the tail of BE 
queue 330B (add.to.BE(p); and p :-head_BE()) at step 420 and discards the packet 
from the BE queue head at step 416. 
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If the total latency is not too large at step 418. the packet discarding block 320 
determines whether an input packet 2 is a RT packet and whether the RT queue length is 
longer than the maximum queue length (tp=RT; and len.>QLEN„) at step 422. If the input 
packet is a RT packet and the RT queue length is too large, the packet discarding block 
320 discards the input RT packet at step 416. 

Likewise, if the RT queue length is not too large or tp = BE at step 422. the packet 
discarding block 320 determines whether an input packet is a BE packet and whether the 
BE queue length is larger than the maximum queue length (tp=BE; and len^>QLEN^) at 
step 424. If the input packet is a BE packet and the BE queue length is too large (tp=BE: 
and len^>QLEN^). the packet discarding block 320 adds the input packet to the tail of 
BE queue 330B (add_to.BE(p); and p := head.BEQ) at steps 426 and 428 and discards 
the packet from the BE queue head at step 430. 

If the BE queue length is not too large or tp = RT at block 424, the packet 
discarding block 320 proceeds to detemnine whether an input packet is a RT packet and 
whether there is a concurrency situation (tp = RT; and Ip <p1) at step 432. If there is a 
concurrency situation, the packet discarding block 320 checks p1 counter (pi := pi - Ip) at 
step 434 and discards a RT packet if the p1 counter indicates that it is time to discard the 

RT packet at step 430. 

If there is no concurrency at step 432. the packet discarding block 320 proceeds 
to determine whether an input packet 2 is a RT packet or a BE packet at step 436. If the 
input packet 2 is a RT packet, the packet discarding block 320 places the input RT packet 
in the appropriate RT queue 330A (add„to_RT(p)) at step 438; othen^ise. the BE queue 

330B (add_to_BE(p)) at step 440. 

The packet scheduling block 340 executes on a regular basis, for example, every 
10 ms for sending packets to the outgoing device in accordance with the bandwidth (BW) 
parameters. The following scheduling algorithm describes the functionality of the packet 
scheduling block 340: 
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Release concurrency parameters if appropriate 
if lerirt + lentye = 0 
then 

Pi = P2 = 0 

5 fi; 

Is it time to send a BE packet through during concurrency 

p = first_of_best_effort{)\ 

if {leribe > 0) 

^ilp<p2) 

10 then 

if 

Ms(BW,f-ffree)>/p 

then 

tfree = tf^e + time(BW./p); 

15 send (p); 

else 

continue: 

n 

fi 

20 Send RT packet 

p = first_of_realJtime{)\ 
if (/enrt > 0) 
then 

if 

25 bits{B\NMfree> Ip 



then 



W=W + time(BW./p); 
send (p); 



else 

30 continue; 

fi 

fi 

Send BE packet 
p = first_of_best_effortO] 
35 if(/en(,e^O) 

then 

^free=^ree + time(BW,/p); 

send(p); 

40 fi; 

Basically, the IP packet scheduling algorithm as described provides several 

underiying functions: The first function relates to determining if both the real-time (RT) 

and best-effort (BE) queues 330A-330B are empty and counters pi and p2 are zero. The 

second function relates to the BE packet and determining whether there is concurrency 

45 (both RT and BE queues 330A-330B are active) and p2 counter indicates that a BE 

packet is to be transmitted. If there is concurrency and p2 counter indicates that a BE 

packet can be transmitted, checking if total bandwidth constraint allows sending of the BE 

packet from the BE queue head. If transmission is allowed, updating the time of next 
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transmission and transmitting the BE packet. The third function relates to the RT packet 
and determining whether the RT queue 330A is not empty and transmission timer is 
permitted. If the RT queue 330A is not empty and transmission timer allows, updating the 
transmission timer and sending the RT packet from the RT queue head. The fourth 
function relates to the BE packet and determining whether the BE queue 330B is not 
empty and transmission timer is permitted. If the BE queue 330B is not empty and 
transmission timer allows, updating the transmission timer and sending the BE packet 
from the BE queue head. 

Referring to FIG. 5, a detailed flowchart representation of an IP packet scheduling 
algorithm of the packet scheduling block 340 is illustrated. The algorithm of the packet 
scheduling block 340 is executed periodically by an operating system (not shown) to 
transmit IP packets from the BE and RT queues 330A-330B. The packet scheduling 
block 340 determines whether both BE and RT queues 330A-330B are empty (lenn + 
lenbe = 0) at step 500 and vrfiether p1 and p2 counters are set at zero (p1 = p2 = 0) at 
step 502. 

After pi and p2 counters are set at zero (p1 = p2 = 0) at step 502, the packet 
scheduling block 340 determines proceeds to select the BE queue head (p = head_BE()) 
at step 504. Next, the packet scheduling block 340 determines if p2 counter indicates 
that a BE packet can be transmitted (lente > 0; and Ip < p2) at step 506. If p2 counter 
indicates that a BE packet can be transmitted, the packet scheduling block 340 checks if 
the total bandwidth constraint allows sending of the BE packet from the BE queue head 
(bits(BW,t - tfree) > Ip) at step 508. If BE packet transmission is allowed, the packet 
scheduling block 340 updates the time of next transmission (t,ree = We + time (BW, Ip)) at 
step 510, and sends the BE packet at step 512. 

Next, the packet scheduling block 340 selects the RT queue head (p = 
head_RT()) at step 514, and determines if the RT queue 330A is not empty at step 516. 
If the RT queue 330A is not empty, the packet scheduling block 340 determines if the 
total bandwidth constraint allows sending of the RT packet from the RT queue head 
(bits(BW,t - tfree) > Ip) at step 518. If RT packet transmission is allowed, the packet 

O103400A2 t > 
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scheduling block 340 updates the time of next transmission (tfree = We + time (BW. Ip)) at 

step 520, and sends the RT packet at step 522. 
\ 

Next, the packet scheduling block 340 selects the BE queue head (p = 
5 head_BE()) at step 524, and determines if the total bandwidth constraint allows sending 
of the BE packet from the BE queue head (bits(BW.t - t,ree) > Ip) at step 526. If BE packet 
transmission is allowed, the packet scheduling block 340 updates the time of next 
transmission (thee = tfree + time (BW, Ip)) at step 528. and sends the BE packet at step 530. 

The operation of the traffic shaping algorithm (including a packet discarding 
10 algorithm and a packet scheduling algorithm) as represented by the functional block 

diagram as shown in FIG. 3 has been verified by simulations using an operating system 
(OS) such as the Unux open-source OS. A 200-byte real-time packet every 20 ms and a 
1500-byte BE packet every 100 ms were provided to the traffic shaping algorithm. The 
number of discarded, queued and scheduled packets of each type was recorded. An 
15 emulated jiffy length (shaper call frequency) of 10 ms was used in the simulations. The 
shaper output bandwidth was averaged over a period of 50 packets or 1000 ms. 

The results can be seen in FIG. 6, which illustrates the shaper output bandwidth 
(bits/second) of the advanced traffic shaper as a function of time (second). The traffic 
shaper 300 is able to use the bandwidth BW efficiently. As shown in FIG. 6, the traffic 
20 shaper 300 implements the BE keep-alive bandwidth, while maintaining - on the average 
~ the total bandwidth constraint. The following parameters are used: the total bandwidth, 
BWtoi = 80 kbits/s. the bandwidth for BE traffic which is maintained even at times when 
there is enough RT traffic to fill the BW of the traffic shaper 300, BWBE.min = 2 kbits/2; the 
maximum latency value for the RT queue 330A, LATs = 50 ms, and the maximum latency 
25 value for the complete queue system 330, LATtot = 1 50 ms. 

FIG. 7 illustrates the length of RT queue 330A as a function of packet sequence 
number. A BE packet is scheduled roughly every 500 packets, and at those times. RT 
packets must be queued up. For demonstration purposes, a higher latency value for the 
RT queue of LATn = 100 ms is used. Other parameters remain the same as those 
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described in FIG. 6. For example. BWtoi = 80 kbits/s, BWBE.min = 2 kbits/2, and LATtot = 
150 ms. 

FIG. 8 shows the cummulative number of discarded real-time packets as a 
function of packet sequence number for a case in which 20% of RT packets must be 

5 discarded and RT queue latency is low (50 ms). The parameters are used: BWtot = 64 

kbits/s. BWBE.min = 2 kbits/2, LATn = 50 ms, and LATtot = 150 ms. The figure is centered at 
the moment when BE packet is scheduled and RT packets must be discarded. It can be 
seen that the algorithm does not discard two adjacent RT packets. 

FIG. 9 illustrates one preferred usage implementation of an IP-based network of a 

10 source terminal and a destination terminal having an advanced traffic shaper incorporated 
therein for controlling traffic bandwidth usage to guarantee proper QoS (Quality of 
Service) for different types of real-time traffic applications while concomitantly providing 
keep-alive bandwidth for best-effort traffic according to the principles of the present 
invention. As shown in FIG. 9, a source terminal 710 may be part of a private data 

15 network 700 such as an ISDN for sending IP packets to a destination terminal 900. An 

advanced traffic shaper 300 of the present invention may be installed at a network egress 
720 of the data network 700 for traffic shaping the IP packets before sending to the 
destination temriinal 900 via an Internet 820. The network egress 720 may also be a 
source terminal for sending IP packets to the destination terminal 900. 

20 A bandwidth-limited link 810 may be used to provide connection between the data 

network 700 and the Internet 820. The IP bandwidth-limited link 10 may represent a low 
bandwidth link such as, for example, an integrated service digital service (ISDN) link and 
a modem link that connect to the network egress 720 of the data network 700 and the 
network ingress 822 of the Internet 820. A network ingress 822 may be an Internet 

25 Service Provider (ISP) Server provided to receive IP packets from the source terminal 
710 of the data network 700. The network ingress 822 may include an advanced traffic 
shaper 300 of the present invention for traffic shaping of real-time traffic from the Intemet 
side toward the source terminal 710. 
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A high-speed link 830 may be used to provide connection between the Internet 
820 and the destination terminal 900. The high-speed link 830 may represent a high 
capacity Internet link of over 100 Mb/s that does not need to prioritize real-time traffic. 
Accordingly, the destination terminal 900 may not require the advanced traffic shaper 300 

5 of the present invention. 

FIG. 10 illustrates another preferred usage implementation of an IP-based 
network of a source terminal and a destination terminal having an advanced traffic shaper 
incorporated therein for controlling traffic bandwidth usage to guarantee proper QoS 
(Quality of Service) for different types of real-time traffic applications while concomitantly 

10 providing keep-alive bandwidth for best-effort traffic according to the principles of the 
present Invention. As shown in FIG. 10. the source terminal 710 may be a stand-alone 
PC for home usage for sending IP packets to the destination temiinal 900 via the Internet 
820. The source terminal 710 may be connected to the Internet 820 through the 
bandwidth-limited link 810 and the network ingress 822, An advanced traffic shaper 300 

15 of the present Invention may be installed at the source terminal 710 for traffic shaping the 
IP packets before sending to the destination terminal 900 via an Internet 820. Similarly, 
the network ingress 822 may include an advanced traffic shaper 300 of the present 
invention for traffic shaping of real-time traffic from the Internet side toward the source 
terminal 710. 

20 As described from the foregoing, the present invention advantageously provides a 

real-time traffic shaper configured for priority fonA/arding of real-time traffic while providing 
keep-alive bandwidth for "best-effort" traffic at the same time. 

While there have been illustrated and described what are considered to be 
preferred embodiments of the present invention, it will be understood by those skilled In 

25 the art that various changes and modifications may be made, and equivalents may be 
substituted for elements thereof without departing from the true scope of the present 
invention. Further, many modifications may be made to adapt a particular situation to the 
teachings of the present invention without departing from the central scope of the present 
invention. Therefore, it is intended that the present invention not be limited to the 
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particular embodiment disclosed as the best mode contemplated for carrying out the 
present invention, but that the present invention includes ail embodiments falling within 
the scope of the appended claims. 
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1 CLAIMS 

2 What is claimed is: 

3 1 . A traffic shaper for shaping traffic in a packet network, comprising: 

4 a packet classifier coupled to receive an incoming packet from said packet network 

5 and to classify the incoming packet as one of a real-time packet and a best-effort packet; 

6 a packet discarding block coupled to perform traffic shaping of the incoming packet 

7 from the packet classifier and discard the incoming packet in accordance with traffic shaping 

8 parameters; 

9 connection queues coupled to temporary store real-time packets and best-effort 

10 packets from the packet discarding block, respectively; and 

1 1 a packet scheduling block coupled to send the real-time and best-effort packets from 

12 the connection queues to an outgoing device in accordance with said traffic shaping 

13 parameters. 

1 2. The traffic shaper as claimed in claim 1 , wherein said connection queues includes a 

2 real-time queue for storing the real-time packets and a best-effort queue for storing the best- 

3 effort packets. 

1 3. The traffic shaper as claimed in claim 2. wherein said packet discarding block 

2 includes packet counters used to balance real-time packet discards in situations where there 

3 is concurrency when both the real-time and best-effort queues are active. 

1 4. The traffic shaper as claimed in claim 3, wherein, said packet discarding block is 

2 executed to discard an incoming packet by: 

3 determining whether the real-time and best-effort queues are empty; 

4 when the real-time and best-effort queues are empty, resetting the counters and a 

5 scheduled transmission time of the next incoming packet; 

6 determining whether a real-time latency is greater than a maximum latency value of 

7 the real-time queue; 

8 when the real-time latency is greater than the maximum latency value of the real-time 

9 queue, discarding the real-time packet input from the packet classifier; 

10 determining whether a total latency is greater than a maximum latency value of both 

1 1 the real-time and best-effort queues; 

12 when the total latency is greater than the maximum latency value of both the real-tim< 

13 and best-effort queues, adding a best-effort packet to a tail of the best-effort queue and 

14 discarding a best-effort packet from a head of the best-effort queue; 
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15 determining whether a length of the real-time queue is greater than a maximum 

16 queue length of the real-time queue; 

17 when the length of the real-time queue is greater than a maximum queue length of 

18 the real-time queue, discarding the real-time packet input from the packet classifier; 

19 determining whether a length of the best-effort queue is greater than a maximum 

20 queue length of the best-effort queue; 

21 when the length of the best-effort queue is greater than a maximum queue length of 

22 the best-effort queue, adding a best-effort packet input from the packet classifier to the tail of 

23 the best-effort queue and discarding a best-effort packet from a head of the best-effort 

24 queue; 

25 determining whether there is concurrency and time to discard a real-time packet to 
2^. make room for best-effort packets; 

27 when there is concurrency and time to discard the real-time packet, discarding the 

28 real-time packet to implement the keep-alive bandwidth for best-effort packets; and placing 

29 the real-time packet that was not discarded in the real-time queue. 

1 5. The traffic shaper as claimed in claim 3, wherein said packet scheduling block 

2 is periodically executed to schedule output of an incoming packet by: 

3 determining whether both the real-time and best-effort queues are empty; 

4 determining whether there is concurrency and time to transmit the best-effort packet 

5 from the best-effort queue; 

6 when there is concurrency and time to transmit the best-effort packet, checking 

7 whether total bandwidth constraint allows transmission of the best-effort packet from the 

8 best-effort queue head; 

when transmission is allowed, updating a time of next transmission and transmitting 

10 the best-effort packet to the outgoing device; 

1 1 detemiining whether the real-time queue is not empty and time for transmission of 

12 the real-time packet Is permitted; 

13 when the real-time queue is not empty and time for transmission of the real-time 

14 packet is permitted, updating the transmission time and transmitting the real-time packet to 

15 the outgoing device from the real-time queue head; 

16 determining whether the best-effort queue is not empty and time for transmission of 

17 the best-effort packet is permitted; and 
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18 when the best-effort queue is not empty and time for transmission of the best-effort 

19 packet is permitted, updating the transmission time and transmitting the best-effort packet to 

20 the outgoing device from the best-effort queue head. 

1 6, The traffic shaper as claimed in claim 1 , wherein said connection queues 

2 correspond to packet buffers constructed from first-in-first-out (FIFO) memory for storing real- 

3 time packets and best-effort packets, respectively. 

1 7. A packet network, comprising: 

2 a source terminal comprising a host and a network interface controller; 

3 a destination terminal comprising a host and a network interface controller; 

4 a bandwidth-limited link providing connection between the source terminal and the 

5 destination tenninal; and 

6 at least one network interface controller of the source terminal. or the destination 

7 terminal comprises a traffic shaper installed therein for shaping traffic In the packet network. 

8 said traffic shaper comprising: 

9 a packet classifier coupled to receive an Incoming packet and to classify the incoming 

10 packet as one of a real-time packet and a best-effort packet; 

11 a packet discarding block coupled to perform traffic shaping of the incoming packet 

12 from the packet classifier and discard the incoming packet in accordance with traffic shaping 

13 parameters; 

14 connection queues coupled to temporary store real-time packets and best-effort 

15 packets from the packet discarding block, respectively; and 

16 a packet scheduling block coupled to send the real-time and best-effort packets from 

17 the connection queues to an outgoing device in accordance with said traffic shaping 

18 parameters. 

1 8. The data network as claimed in claim 7, wherein said connection queues 

2 includes a real-time queue for storing the real-time packets and a best-effort queue for 

3 storing the best-effort packets. 

1 9. The data networtc as claimed in claim 7, wherein said bandwidth-limited link 

2 corresponds to one of a digital sen/ices digital network (ISDN) link and a modem link with low- 

3 bandwidth for providing connection between the source terminal and the destination tenninal. 
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29 placing the real-time packet that was not discarded in the real-time queue. 

1 13. The data network as claimed in claim 8, wherein said packet scheduling block 

2 is periodically executed to schedule output of an incoming packet by: 

3 determining whether both the real-time and best-effort queues are empty; 

4 determining whether there is concurrency and time to transmit the best-effort packet 

5 from the best-effort queue; 

6 when there is concurrency and time to transmit the best-effort packet, checking 

7 whether total bandwidth constraint allows transmission of the best-effort packet from the 

8 best-effort queue head; 

9 when transmission is allowed, updating a time of next transmission and transmitting 

10 the best-effort packet to the outgoing device; 

1 1 determining whether the real-time queue is not empty and time for transmission of 

12 the real-time packet is permitted; 

13 when the real-time queue Is not empty and time for transmission of the real-time 

14 packet is pemiitted. updating the transmission time and transmitting the real-time packet to 

15 the outgoing device from the real-time queue head; 

16 determining whether the best-effort queue is not empty and time for transmission of 

17 the best-effort packet is permitted; and 

18 when the best-effort queue is not empty and time for transmission of the best-effort 

19 packet is permitted, updating the transmission time and transmitting the best-effort packet to 

20 the outgoing device from the best-effort queue head. 

1 14. The data network as claimed in claim 7, wherein said source terminal is 

2 connected to one of an integrated services digital network (ISDN). 

15. The data network as claimed in claim 7. further comprising an Internet Service 

2 Provider (ISP) and an Internet disposed between the bandwidth-limited link and the 

3 destination terminal. 

1 16. The data network as claimed in claim 7, wherein said traffic shaper is an 

2 algorithm configured for traffic shaping and avoiding correlated loss for real-time streams 

3 while providing keep-alive bandwidth for best-effort traffic. 

1 17. A computer usable medium having computer readable program code means 

2 embodied therein a traffic shaper algorithm for use in a source terminal for 

3 shaping traffic in a packet network, comprising: 

4 a packet classifier module configured to receive an incoming packet and to classify 

5 the incoming packet as one of a real-time packet and a best-effort packet; 
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6 a packet discarding module configured to perform traffic shaping of the incoming 

7 packet from the packet classifier and discard the incoming packet in 

8 accordance with traffic shaping parameters; 

9 a connection queue module configured to temporary store real-time packets and 

10 best-effort packets from the packet discarding block, respectively; and 

1 1 a packet scheduling module configured to send the real-time and best-effort packets 

12 from the connection queues to an outgoing device in accordance with said 

13 traffic shaping parameters. 

1 18. The computer usable medium as claimed in claim 17. wherein said connection 

2 queue module contain a real-time queue for storing the real-time packets and a best-effort 

3 queue for storing the best-effort packets. 

1 19. The computer usable medium as claimed in claim 17, wherein said packet 

2 discarding module is configured to discard an incoming packet by: 

3 determining whether the real-time and best-effort queues are empty; 

4 when the real-time and best-effort queues are empty, resetting the counters and a 

5 scheduled transmission time of the next Incoming packet; 

6 determining whether a real-time latency is greater than a maximum latency value of 

7 the real-time queue; 

8 when the real-time latency Is greater than the maximum latency value of the real-time 

9 queue, discarding the real-time packet input from the packet classifier; 

10 determining whether a total latency is greater than a maximum latency value of both 

1 1 the real-time and best-effort queues; 

12 when the total latency is greater than the maximum latency value of both the real-time 

13 and best-effort queues, adding a best-effort packet to a tail of the best-effort 

14 queue and discarding a best-effort packet from a head of the best-effort 

15 queue; 

16 determining whether a length of the real-time queue is greater than a maximum 

17 queue length of the real-time queue; 

18 when the length of the real-time queue is greater than a maximum queue length of 

19 the real-time queue, discarding the real-time packet input from the packet 

20 classifier; 

21 determining whether a length of the best-effort queue is greater than a maximum 

22 queue length of the best-effort queue; 
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1 1 0. The data network as claimed in claim 7, wherein said connection queues 

2 correspond to packet buffers constructed from first-in-first-out (FIFO) memory for storing real 

3 time packets and best-effort packets, respectively. 

1 1 1 . The data network as claimed in claim 8, wheirein said packet discarding block 

2 includes packet counters used to balance real-time packet discards in situations where there 

3 is concun-ency when both the real-time and best-effort queues are active. 

1 1 2. The data network as claimed in claim 8. wherein said packet discarding block 

2 is executed to discard an incoming packet by: 

3 determining whether the real-time and best-effort queues are empty; 

4 when the real-time and best-effort queues are empty, resetting the counters and a 

5 scheduled transmission time of the next incoming packet; 

determining whether a real-time latency is greater than a maximum latency value of 

7 the real-time queue; 

8 when the real-time latency Is greater than the maximum latency value of the real-time 

9 queue, discarding the real-time packet input from the packet classifier; 

10 detennining whether a total latency is greater than a maximum latency value of both 

1 1 the real-time and best-effort queues; 

12 when the total latency is greater than the maximum latency value of both the real-tim 

13 and best-effort queues, adding a best-effort packet to a tail of the best-effort queue and 

14 discarding a best-effort packet from a head of the best-effort queue; 

15 detemiining whether a length of the real-time queue is greater than a maximum 

16 queue length of the real-time queue; 

17 when the length of the real-time queue is greater than a maximum queue length of 
the real-time queue, discarding the real-time packet input from the packet classifier; 

19 determining whether a length of the best-effort queue is greater than a maximum 

20 queue length of the best-effort queue; 

21 when the length of the best-effort queue is greater than a maximum queue length of 

22 the best-effort queue, adding a best-effort packet Input from the packet classifier to the tail c 

23 the best-effort queue and discarding a best-effort packet from a head of the best-effort 

24 queue; 

25 determining whether there is concurrency and time to discard a real-time packet to 

26 make room for best-effort packets; 

27 when there is concurrency and time to discard the real-time packet, discarding the 

28 real-time packet to implement the keep-alive bandwidth for best-effort packets; and 
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23 When the length of the best-effort queue is greater than a maximum queue length of 

24 the best-effort queue, adding a best-effort packet Input from the packet 

25 classifier to the tail of the best-effort queue and discarding a best-effort packet 

26 from a head of the best-effort queue; 

27 determining whether there is concurrency and time to discard a real-time packet to 

28 make room for best-effort packets; 

29 when there is concurrency and time to discard the real-time packet, discarding the 

30 real-time packet to implement the keep-alive bandwidth for best-effort packets; 

31 and 

32 placing the real-time packet that was not discarded in the real-time queue. 

1 20. The computer usable medium as claimed in claim 17. wherein said packet scheduling 

2 block is configured to periodically schedule output of an incoming packet by: 

3 detemiining whether both the real-time and best-effort queues are empty; 

4 determining whether there is concurrency and time to transmit the best-effort packet 

5 from the best-effort queue; 

6 when there Is concurrency and time to transmit the best-effort packet, checking 

7 whether total bandwidth constraint allows transmission of the best-effort 

8 packet from the best-effort queue head; 

9 when transmission is allowed, updating a time of next transmission and transmitting 

10 the best-effort packet to the outgoing device; 

11 detemiining whether the real-time queue is not empty and time for transmission of 

12 the real-time packet is pemiltted; 

13 when the real-time queue is not empty and time for transmission of the real-time 

,4 packet is permitted, updating the transmission time and transmitting the real- 

,5 time packet to the outgoing device from the real-time queue head; 

16 determining whether the best-effort queue is not empty and time for transmission of 

17 the best-effort packet Is pemiitted; and 

18 when the best-effort queue is not empty and time for transmission of the best-effon 

19 packet is permitted, updating the transmission time and transmitting the best- 

20 effort packet to the outgoing device from the best-effort queue head. 
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